Learning with Deep Cascades
نویسندگان
چکیده
We introduce a broad learning model formed by cascades of predictors, Deep Cascades, that is structured as general decision trees in which leaf predictors or node questions may be members of rich function families. We present new detailed data-dependent theoretical guarantees for learning with Deep Cascades with complex leaf predictors or node question in terms of the Rademacher complexities of the sub-families composing these sets of predictors and the fraction of sample points correctly classified at each leaf. These general guarantees can guide the design of a variety of different algorithms for deep cascade models and we give a detailed description of two such algorithms. Our second algorithm uses as node and leaf classifiers SVM predictors and we report the results of experiments comparing its performance with that of SVM combined with polynomial kernels.
منابع مشابه
IDK Cascades: Fast Deep Learning by Learning not to Overthink
Advances in deep learning have led to substantial increases in prediction accuracy but have been accompanied by increases in the cost of rendering predictions. We conjecture that for a majority of real-world inputs, the recent advances in deep learning have created models that effectively “over-think” on simple inputs. In this paper we revisit the question of how to effectively build model casc...
متن کاملDeepCas: An End-to-end Predictor of Information Cascades
Information cascades, effectively facilitated by most social network platforms, are recognized as a major factor in almost every social success and disaster in these networks. Can cascades be predicted? While many believe that they are inherently unpredictable, recent work has shown that some key properties of information cascades, such as size, growth, and shape, can be predicted by a machine ...
متن کاملP3: Mechanisms of TrkB-Mediated Hippocampal Long-Term Potentiation in Learning and Memory
Long-term potentiation (LTP) is a process that certain types of synaptic stimulation lead to a long-lasting enhancement in the strength of synaptic transmission. Studies in recent years indicate the importance of molecular pathways in the development of memory and learning. Tropomyosin receptor kinase B (TrkB) is a member of the neurotrophin receptor tyrosine kinase family, that its ligand is b...
متن کاملThe Relationship of Study and Learning approaches with Students’ Academic Achievement in Rafsanjan University of Medical Sciences
Introduction: Most experts consider learning approach as the fundamental basis of learning dividing it into two parts of deep learning approach and surface learning approach. This is an endeavor to investigate the relationship between learning and study approaches with academic achievement among students in Rafsanjan University of Medical Sciences. Methods: This descriptive cross-sectional stu...
متن کاملDeep Adversarial Robustness
Deep learning has recently contributed to learning state-of-the-art representations in service of various image recognition tasks. Deep learning uses cascades of many layers of nonlinear processing units for feature extraction and transformation. Recently, researchers have shown that deep learning architectures are particularly vulnerable to adversarial examples, inputs to machine learning mode...
متن کامل